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Abstract 


In  our  work  we  introduce  a  framework  for  exploring  array  detection  problems  in  a  reduced 
dimensional  space  by  exploiting  the  theory  of  invariance  in  hypothesis  testing.  This  involves 
calculating  a  low  dimensional  basis  set  of  functions  called  the  maximal  invariant,  the  statistics 
of  which  are  often  tractable  to  obtain,  thereby  making  analysis  feasible  and  facilitating  the 
search  for  tests  with  some  optimality  property.  Using  this  approach,  we  obtain  a  locally  most 
powerful  test  for  the  unstructured  covariance  case  and  show  that  the  Kelly  and  AMF  detectors 
form  an  algebraic  span  for  any  invariant  detector.  Applying  the  same  framework  to  structured 
covariance  matrices,  we  gain  some  insights  and  propose  several  new  detectors  wliich  are  shown 
to  outperform  existing  detectors. 

In  this  final  report  we  explain  the  key  components  of  this  work.  The  most  detailed  compi¬ 
lation  of  our  work  to  date  is  found  in  a  recently  submitted  paper  [7],  a  copy  of  which  we  have 
enclosed. 


Introduction 


The  problem  of  detecting  a  signal  vector  of  known  direction  but  unknown  strength  in  Gaussian 
noise  whose  covariance  matrix  is  unknown  has  received  much  attention  lately.  In  [C],  Reed  et  al 
used  the  sample  covariance  estimate  from  secondary  (signal  free)  data  vectors  to  derive  a  weight 
vector  for  use  in  an  adaptive  matched  filter  (AMF)  detector.  KeUyl-^  used  the  Generalized 
Likelihood  Ratio  (GLR)  procedure  to  derive  a  constant  false  alarm  rate  (CFAR)  test.  Both 
methods  assume  that  the  covariance  matrix  is  completely  unknown  (unstructured).  In  many 
applications,  however,  the  array  geometry  and  partial  information  of  the  noise  environment 
(number  of  interferers,  rough  bearing  estimates  etc.)  impose  a  structure  on  the  covariance 
matrix.  It  has  been  shown  in  [1]  and  [3]  that  the  use  of  structured  covariance  estimates  results 
in  a  significant  improvement  in  performance  in  terms  of  gain  in  PD  and  reduction  in  the  number 
of  secondary  data  vectors  required. 

In  this  research,  we  introduce  a  framework  for  studying  the  optimality  properties  of  these 
tests.  We  consider  the  following  structure  for  the  covariance  matrix: 


R=  'I'B'If"  +  ARo  (1) 

where  R(N  x  N)  is  the  covariance  matrix,  $(iV  x  d)  spans  a  rank-d  subspace  and  Rq  is  a  known 
covariance  matrix.  For  this  research,  we  assume  that is  known  while  B  and  A  are  not.  This 
structure  not  only  corresponds  to  the  case  of  a  low  rank  interference  component  in  a  dominant 
subspace  (which  frequently  arises  in  narrow-band  processing  when  the  noise  has  an  interference 
component  due  to  a  small  number  of  sources  superimposed  on  the  receiver  noise  which  is  usually 
white);  but  also  as  a  special  case  reduces  to  the  unstructured  matrix  when  d  equals  N .  We  shall 
therefore  work  with  this  model  to  obtain  general  results  which  can  then  be  applied  to  specific 
instances.  By 
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Another  case  is  the  block  diagonal  form  for  the  covariance  which  may  be  used  to  mode!  a 
non-stationary  environment. 

Unfortunately,  it  turns  out  that  for  these  covariance  structures,  with  the  signal  bearing  and 
waveform  known,  it  becomes  intractable  to  use  the  GLR  procedure  to  obtain  a  test  statistic. 

Consequently,  we  approach  signal  detection  from  the  viewpoint  of  the  general  theory  of 
hypotheses  testing.  We  model  the  signal  strength  as  deterministic-unknown.  This  along 
with  the  unknown  covariance  matrix  become  the  parameters  describing  the  distribution  of  the 
observed  data  vectors.  The  problem  of  signal  detection  becomes  one  of  choosing  between  two 
disjoint  parameter  sets  based  on  the  obse'-vations.  Thus  we  have  the  following  hypothesis  resting 
problem: 

Given 

^^NxL  ~  M{nae^  ,R%  I)  (2) 

where  the  columns  of  X  are  independent  data  vectors  each  normally  distributed  with  covariance 
i?  as  in  (1),  a  is  the  signal  vector  (known),  possibly  present  only  in  the  first  column  and  /i  is  its 
strength  (unknown). 

Test 

Ho  :  /a  =  0  versus  Hi  :  /r  7^  0 

Note  that  the  covariance  is  a  nuisance  parameter  which  should  not  affect  the  decision  statis¬ 
tic.  This  motivates  us  to  reduce  the  problem  as  follows.  Transformations  on  the  data  that 
induce  transformations  on  the  parameters  to  which  the  parameter  sets  are  invariant  leave  the 
decision  problem  unchanged.  Therefore,  the  decision  statistic  should  also  be  invariant  to  all 
such  transformations.  More  concretely,  this  can  be  formulated  as  follows: 

Let  X  be  the  data  characterized  by  the  probability  distribution  Pg,  9  £  and  let  g  be  a 
1  :  I  onto  transformation  on  the  sample  space  such  that  gX  is  distributed  as  Ps-,  9'  6  fl.  This 
transformation  thereby  induces  a  transformation  g  on  the  parameter  space.  It  is  shown  in  [4] 
that  the  set  of  all  transformations  g,  such  that  the  corresponding  induced  transforn.ation  ^  is  a 
1  ;  1  map  of  Q.  onto  itself,  form  a  group. 

The  decision  problem  HO  :  0  €  flo  vs  Hi  :  5  6  fir 
is  invariant  to  the  group  of  transformations,  G,  if  gQi  =  fl,  z  =  0, 1  for  all  5  6  G.  In  that  case 
we  require  the  decision  statistic  to  be  invariant  to  all  transformations  in  G. 

This  principle  of  invariance  (Lehmann^"*!)  greatly  reduces  the  class  of  detectors  to  be  con¬ 
sidered  and  frequently,  it  may  become  possible  to  find  a  uniformly  most  powerful  test  within 
this  smaller  invariant  class  (UMPI),  even  though  no  general  UMP  test  may  exist.  Often,  the 
GLR  procedure  leads  to  such  a  test.  In  our  case,  since  the  GLR  is  unavailable,  we  proceed  by 
deriving  the  group  of  transformations  that  leave  the  problem  invariant.  From  this,  we  obtain 
the  maximal  invariant,  which  is  the  algebraic  basis  for  the  largest  set  of  independent  functions 
of  the  data  that  are  invariant  to  the  transformations.  These  functions  separate  the  sample  space 
into  orbits  or  invariant  subsets.  Thus,  M{X)  is  a  maximal  invariant  iff 

M{X)^  M{g{X)),^g£G  (3) 

M(Xi)  =  M{X2)^  Xi  =  giXi)  for  some  geG 

It  is  shown  in  [4]  that  all  invariant  test  statistics  are  functions  of  the  majcimal  invariant,  whose 
distribution  depends  on  a  reduced  parameter  set  (this  may  eliminate  the  nuisance  parameters 
from  the  problem,  which  is  a  very  desirable  feature).  The  maximal  invariant  turns  out  to  be  a 
small  set  and  it  is  feasible  to  come  up  with  a  reasonable  test  statistic. 
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A  Maximal  Invariant  Framework 

To  begin,  consider  as  a  special  case  of  (1)  the  following  structure 


\  0  ) 

This  is  completely  equivalent  to  equation  (  1)  with  =  Z?  +  since  it  can  be  obtained 

by  a  known  linear  transformation  on  the  data.  Again,  for  the  same  reason,  we  can  assume  the 
following  form  for  the  signal  vector,  a,  and  partition  the  data  matrix  accordingly: 


,  X  = 


In  ^12 
l2i  l22 
I31  3:32 

1^1  l42 


where  in  is  1  X  1,  ii2  is  1  x  (Z,  -  1),  121  is  (ti  —  1)  x  1,  131  is  I  x  1  and  i.n  is  (,V  -  d)  x  1 
We  can  represent  this  matrix  as  a  length-NL  vector 


where  vec(A)  =  [A^  A^  . . .  A^]^  for  A  =  [Ai  :  A2  :  •  •  • :  A/v] 

This  is  distributed  as  a  Gaussian  vector  with  mean  fia  and  covariance  (iia(j{R^®[i 
where  ®  denotes  the  Kronecker  product. 

This  decision  problem  is  invariant  to  all  transformations  which  preserve  the  Gaussian  nature 
of  the  distribution,  the  mean  vector  to  a  scale  factor  and  the  structure  of  the  covariance  matrix. 
The  largest  group  of  such  linear  transformations  are  given  by  'r(i)  =  Gx  where 


C7  =  Of 


1  0 

0  Ut 


where  Ui{L  —  1)  and  U2{{N  —  d)L  -  1)  are  unitary  matrices,  is  (1  x  L  -  1)  ai  d  F  is 
(yV  -  1  x  L  -  1). 

We  show  in  [7]  that  the  maximal  invariant  to  this  group  of  transformations  is  given  by 


II  3:11  - 

H2(/  -  I^(i223:"2)"^^22)3:{2 
lfl(l22X^)"*X21 


!|a:32!P  +  t|a;4l|p  +  ||l42Hf 

Xu  -  2:i2X.^(x22a;22)"‘a:2i 
7714  =  M- 

I31 

A  corresponding  maximal  invariant  in  the  parameter  set  is  given  by 

{fi0)n 

0;  = 


(8) 


(9) 


Thus  we  have  greatly  reduced  the  dimensionality  of  the  problem.  VVe  obtain  the  density 
function  for  the  maximal  invariant  [7]  which  is  now  parameterized  by  6\  and  6^2  above.  We  show 
there  that  no  UMP  test  exists  for  this  problem.  Further,  since  Q-i  is  a  free  parameter  even  under 
Ho,  the  distribution  function  of  the  maximal  invariant  is  not  completely  specified  thereunder  and 
hence  an  invariant  decision  statistic  will,  in  general,  not  have  the  CF.4R  property.  Approximate 
CF.4Ruess  is  all  one  can  hope  for. 

For  the  unstructured  case,  the  maximal  invariant  reduces  even  further,  to  nii  and  m2  and 
the  corresponding  parameter  set  to  a  single  parameter  9x  (which  is  the  SNR).  The  distribution 
function  under  HO  only  depends  on  the  dimension  of  the  data  set,  and  so  in  this  case,  any 
invariant  decision  rule  will  be  CFAR.  Again,  in  this  case  no  UMP  test  e.xists.  However,  in 
many  applications  the  performance  is  critical  only  for  low  SNR  and  a  locally  most  powerful 
invariant  test(LMPI)  in  the  limit  of  zero  SNR  is  of  interest.  Since,  the  parameter  space  is  one 
dimensional,  it  becomes  feasible  to  obtain  the  LMPI  test  statistic  following  the  theory  in  [.5]. 
The  LMPI  decision  rule  in  the  limit  of  Bq  is  given  by: 


fSLkri  >v 

/«o  Ho 

where  f  is  the  density  function  of  x  with  parameter  9. 

In  [7]  we  derive  the  following  density  function  for  mi  and  m2: 

,,  ,  ,  (1  +  _ *1 — 

/(mi, mo)  =  fci— - ; - ■+">.+'"0 

(I  +  mi  +  mo)^  ” 

L-N  „ 

_ ^>^‘1 _ 

'  ^(1  +  m2)(l  +  mi  +  mo) 

where  h  =  ^2  =  c^N^k\k\ 

Applying  the  rule  in  (10),  we  obtain  the  following  L./^I  tost: 


(10) 


{L-N)tK-l 
(l  +  m2)(t/v+l) 


(12) 


where  t/c  =  mi/(l  +  m2)  is  the  Kelly  statistic. 

The  pfa  is  closed  form  [7],  and  the  detection  probability  is  calculated  numerically  as  a  finite  sum 
of  simple  integrals.  Preliminary  comparisons  with  the  Kelly  statistic  indicate  a  slightly  better 
performance  at  very  low  SNR  (a  gain  of  0.1  dB  for  IV  =  4,  L  =  9,  p/a  =  -1  at  -.5dB  SNR) 
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at  the  expense  of  a  degradation  in  the  higher  SNR  region  (O.ddB  loss  at  lOdB  SNR).  Further 
simulations  are  shown  in  [7]. 

Finally,  we  note  that  mi  is  exactly  the  AMF  statistic  and  the  KeUy  statistic  is  mi /(I  +  m2). 
Thus  these  two  form  an  equivalent  basis  set  to  mi  and  m2.  This  implies  that  they  form  an 
algebraic  basis  for  all  invariant  detectors  and  in  searching  for  viable  detectors,  it  is  sufficient  to 
look  at  compositions  of  them.  It  is  not  necessary  to  explore  alternative  ways  of  projecting  down 
the  initial  raw  high-dimensional  data. 

Detectors  for  subspace  covariance  structures 

We  consider  above  the  case  when  the  matrix  is  unstructured,  as  per  Kelly  and  Reed.  We  saw  that 
the  KeUy  and  Reed  tests  are  both  equally  valid  since  they  are  basis  functions  for  all  invariant 
detectors.  We  also  found  the  LMPI  test.  We  extended  our  work  to  the  subspace  structured 
covariance  case  [7].  This  problem  is  important  for  enhanced  detection  because  exploitation  of 
covariance  structure  allows  one  to  converge  to  reliable  detection  with  fewer  snapshots.  ROC 
curves  are  shown  in  [7],  which  demonstrate  that  the  invariant  tests  outperform  previous  ad  hoc 
solutions. 

Conclusion  and  Comments 

Detection  in  an  array  environment  involves  projecting  down  the  multivariate  data  to  a  scalar 
statistic.  Since  any  reasonable  statistic  must  satisfy  the  invariance  criterion,  the  ma.ximal  in¬ 
variant  set  specifies  all  the  functions  one  need  consider  in  devising  the  detector.  Since  this  set  is 
often  small,  it  is  feasible  to  do  analysis  and  search  for  a  detector  with  some  optimality  property 
with  the  confidence  that  the  search  is  over  the  whole  class  of  reasonable  detectors.  This  frame¬ 
work  provides  an  alternate  route  to  conventional  methods  like  the  GLRT  for  arriving  at  decision 
rules  and  further  enables  the  study  of  their  optimality  properties.  Thus,  for  the  unstructured 
covariance  case  studied  by  Kelly  and  others,  we  show  that  the  Kelly  and  the  AMF  statistics  form 
a  maximal  invariant  set.  Further,  we  show  that  a  UMPI  does  not  e.xist  and  obtain  a  LMPI  test 
around  0  SNR.  The  Kelly  detector  is  seen  to  perform  nearly  as  well  which  is  a  good  endorsement 
for  its  use.  For  the  structured  covariance  ca^e  where  the  GLRT  breaks  down,  we  again  obtain  a 
small  invariant  set  whose  statistics  can  be  analyzed.  For  this  ca.se,  the  UMP  test  does  not  e.xist. 

We  have  derived  e.xtensions  [7]  of  our  test  for  cases  when  there  are  various  unknown  param¬ 
eters  in  the  target  signal  waveform  and/or  bearing.  This  has  relevence  in  applications  involving 
range  migration  such  as  occurs  with  accelerating  targets.  We  are  in  the  process,  under  a  new 
AFOSR  grant  of  (i)  e.xtending  our  work  to  testing  for  spatial  stationarity  as  arises  in  faulty 
sensor  and/or  near  field  source  detection,  and  (ii)  applying  our  tests  to  real  data. 
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